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ABSTRACT 

This presentation describes the use of portfolio 
assessment in a teacher education course "Teaching Reading in the 
Content Areas/' which is required for secondary certification. 
Portfolio assessment provides students with opportunities to 
determine which skills are most congruent with their respective 
areas. The main body of this paper describes a teacher educator's 
experiences with portfolio assessment in each of four semesters. Data 
sources included the teacher educator's reflective journal, student 
journals, notes and observations made during class discussions and 
activities, notes from portfolio exit conferences, discussions with 
colleagues, sample portfolios, and course materials related to 
portfolio development. Lessons were learned and refinements made in 
each of the four semesters. Among the items found to be helpful for a 
teacher initiating portfolio assessment were: clearly identify 
purpose(s); involve students in the process; schedule 
work-in-progress and information sessions; provide written 
descriptions, explanations, and expectations; display exemplar 
portfolios; link process/product to overall program goals; conduct 
exit conferences; systematically monitor impact on student learning 
and modify accordingly; and, if possible, work with a colleague to 
initiate or refine use of portfolio assessment. Appendixes provide: 
samples of a formative assessment (midterm portfolio); a final 
portfolio; assessment criteria; a portfolio scoring rubric; 
discussion of portfolios as progress and product: a construction 
metaphor; and portfolio summary data including categories of evidence 
such as growth and development, and change in perspective or belief. 
(Contains 21 references.) (LL) 
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PORTFOLIO ASSESSMENT AND SECONDARY METHODS CLASSES: 
WHAT HAPPENS WHEN THE TWAIN MEET? 

Introduction and Overview 

My dissatisfaction with traditional forms of assessment has deep 
roots. As a former Chapter I reading teacher in the 1970 's I detected 
disparity between standardized test scores and classroom performance. 
As a middle grades social studies teacher I noticed differences 
between test scores, homework assignments p and what students were 
actually able to apply in projects or simulations. And as a teacher 
educator I quickly realized that "objective" tests were incapable of 
measuring the types snd ranges of knowledge critical for assessing 
preservice teacher development and performance. 

Although I added concept mapping to my instructional and 
assessment repertoire in the late 1980's, I continued to search for 
supplementary procedures thst would teach as well as measure or 
document understanding. Schon (1987), Tabachnich and Zeichner (1991), 
and others convinced me that reflection positively impscts tescher 
development. Consequently, learning logs or journsls were sdded to my 
instructional/assessment repertoire in the early 1990's. By Psll 1992 
when I accepted a position at Indiana State University, 1 hsd also 
determined that portfolio assessment was worth a try. 1 agreed with 
Vito Perrone who noted that we need "different assessments that get 
closer to student learning snd are related to performance and 
understanding" (1991, p. viii) snd with Albert Einstein who reportedly 
posted on his office wall, "Not everything that counts can be counted 
and not everything that can be counted counts." 
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My primary teaching responsibility is CIMT 366 - Teaching Reading 
in the Content Arses. It is required for secondary certification and 
includes students from all subject areas (i.e. English, Meth, Social 
Studies, Science, Music, Art, Physical Education, Poreign Language, 
Technology Education, Health, Special Education, etc.). Most students 
are in their junior yesr; all have completed an Introduction to 
Teaching course and a course in Bducstional Psychology, but constants 
end there. As a result, course concepts and methods have varying 
degrees of applicability depending on aubject area* Thia was a 
primary reason for experimenting with portfolio aaaeaament - I thought 
it would provide students with opportunities to determine which 
reading, writing, listening, speaking, and thinking for learning 
strategies were most congruent with their respective sreee. In fsct, 
we begin each semester by informally renaming the courae "Teaching end 
Learning in the Content Areas" to broaden the acope beyond reading and 
to set the stage for alternative pedagogy as well ss related 
assessment issues, one of which is portfolio aaaeaament* 

While I continued my search for more appropriate ways to promote 
and assess student learning, uae of portfolioa continued to gain in 
popularity. For example, aeminel work of the four-year Teacher 
Assessment Project (TAP) provides cogent insights into the types of 
assessments thst might document the complexities of tesching snd 
learning to teach (Collins, 1991). Althou' separate from the 
National Board on Profeaaional Teaching Standards (NBPTB ) , it purposed 
to provide reaearch on aaaeaament procedurea that would inform the 
Board's work (Hsertel, 1991). 
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TAP portfolio field test results and other research indicate that 
the process of portfolio development tends to promote reflection about 
teaching , particularly as it relates to instructional Methods (Varvus 
& Collins, 1991, Wolf, 1991a & b) . Portfolios can also provide 
valuable insights into the professional development of preservice 
students (Stone* 1993). Consequently, use of portfolios in a class 
which hopes to promote reflection and decision-making about the most 
appropriate instructional methods to select from the array of content 
area literacy/learning teaching strategies (CAL/LTS) available seemed 
natural and appropriate. 

The rest of this paper will describe refinement of use of 
portfolios from Fall 1992 through Fall 1993. It will close with a 
summary and discussion of findings and offer suggestions for portfolio 
assessment in methods classes and teacher preparation programs. Data 
sources include my reflective journal, student journals, notes and • 
observations made during class discussions and activities, notes from 
portfolio exit conferences, discussions with colleagues, sample 
portfolios, and course materials related to portfolio development. 

A Portfolio Assessment Refinement Journey: Fall 1992 - Fall 1993 

fall 1322 

Fall semester 1992 marked the beginning of our portfolio 
experience. It was one of four projects or experiences upon which 
student evaluation was based. Additional criteria were: 1) early 
field experience log/inquiry project, 2) oral and written 
participation (learning log/ journal and discussion) , and 3) concept 
maps (Rafferty & Fleschner, 1993). (See Appendix C for details.) 
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Rather than tell students exactly what to put into their portfolios, 

we spent class tine constructing lists of potential items. During 

week 3, ay reflective journal entry read! 

It took valuable class time to negotiate a shared understanding 
of portfolios. Doesn't seen to be much resistance yet - maybe 
because no one is working on it? It was wise for me to withhold 
my list of potential things to include - most students noticed 
the similarities between their lists and mine and remarked on the 
ownership that resulted from their participating in the activity. 

Several weeks later we held a "Portfolio Show and Tell." 
Students were reminded th&t it was their responsibility to "prove, 
demonstrate, or show WHAT they were learning and HOW they know it." 
Although students told me that the aession had helped them by: 
1) assuring them of being on the right track, 2) providing tips on how 
to organize, and 3) giving them additional packaging ideaa, within 
days there were requests for more structure for the process. 

At the time, the request seemed reasonable - this was a new 

experience for all. Consequently, I constructed a checklist entitled 

"Formative Assessment - Midterm Portfolio" (See Appendix A). Note 

that the rating scale encouraged student reflection on choices - 

whether items were included or not. Unfortunately aelection did not 

occur, as indicated in my week 8 journal entry. 

The use of a checklist compelled students to include everything! 
There was not much reflection on items included either. What 
needs to be done to encourage selective inclusions rather than a 

notebook approach? 

Many of my questions and dilemmas would remain throughout the 
semester. My inexperience with directing the process and time 
constraints precluded any refinements during Pall 1992 . As a result, 
when students requested a revised checklist for the final portfolio, I 
complied (See Appendix B). Nonetheless, my end-of -semester journal 



entry captures both my dissatisfaction and on-going search for a more 

viable approach. 

Of the three experiments this semester, this is the one with 
which I am least satisfied. There has to be a way to identify 
more important or minimal standard items to include , but then 
that seems contrary to the philosophy of portfolios . I'll need 
to do some additional reading and thinking about this one. A 
major problem was lack of reflection/evidence of understanding of 
the material. Some included items without documenting or 
verifying their importance or relationship to the course. This 
portfolio component will require restructuring. 

Although I was dissatisfied with this initial attempt, our experience 

with portfolios underscored the importance of using multiple criteria 

for student evaluation. In other words, because final grades were not 

based exclusively on the portfolio there was not as much pressure for 

initial perfection. In addition, this experience also attests to the 

power and value of teacher reflection. I was determined to improve 

the process. 

Spring 1993 

Between Pall 1992 and Spring 1993 I read about the importance of 

purpose in assessment selection and design and use of rubrics for more 

reliable scoring (Herman, Aschbacher, & Winters, 1992). This resulted 

in an assessment criteria handout (See Appendix C), a series of class 

work sessions that yielded a portfolio scoring rubric, and portfolio 

exit conferences at semester's end. An additional change documented 

in my journal during week 2 was that I was: 

spending more time asking questions and having students think 
about how to be working on the portfolio (earlier in the 
semester) . 

Following the pattern established Fall 1992, we held a "Portfolio 
Show and Tell" session during week 4. However, rather than using s 
midterm checklist, we had several rounds of portfolio exchanges to 



note types of items included end vsrious organizational structures. 
We also spent considerable class time drafting scoring rubric criteria 
(See Appendix D). Students noted that it was difficult to construct 
the rubric descriptions because 1 ) it was hard to find words to 
describe the grade categories and 2) that student an' teacher 
perceptions may not be congruent. Others noted that they were 
"uncomfortable with the fact that this kind of (evaluation would result 
in different inclusions (in the portfolio) and potential for 
subjective evaluation • 91 Despite a course emphasis on individual 
differences, students obviously struggled with application to 
themselves as learners. 

As we continued work on scoring rubrics over the next few weeks 
an inevitable discussion item was student concern over "not knowing 
where they stand. 91 Probing revealed a focus on grades rather than 
concern wi th their levels of learning/understanding • Apparently 
students are so accul turated into the testing/grading paradigm that it 
is moat difficult to engender self-evaluation tendencies and 
abilities. Of course, this is likely related to Lortie's (1975) 
notion of "teachers teaching the way they were taught/ 1 but it alao 
represents a particularly challenging scenario for those of us 
implementing portfolio assessment in individual courses without 
overall program support. (This challenge continues into the current 
semester ~ Spring 1994 - but did begin to shift during Fall 1993, as 
will be addressed in subsequent sections.) 

Eventually, however, we finalized the rubric criteria which 
students used to prepare final portfolios (See Appendix D). During 
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individual exit conferences at semester's end, we explore the 
f oJ lowing questions : 

1) How has your thinking about teaching and learning changed, grown, 
and ->r developed this semester? 2) How does your portfolio document 
this? 3) Using the scoring rubric, what grade do you deserve and why? 

Analysis of notes taken during exit conferences indicated 
issues/concerns as well as benefits/advantages regarding the portfolio 
«s a process and product. 

Issues/Concerns Benefits /Advantages 

-Organization skills -Valuable future resource 

-Time management -Constructed for personal use 

-Time constraints -Connections to major/minor 

-Could have done more 
-Reactions/Reflections 

Students who claimed they "worked over time" or used time management 
to complete the portfolio tended to do better in all respects. 
Nonetheless, even these students had difficulty saying they deserved 
an "A." Many, however , seemed to need more structure or scaffolding 
to avoid results largely sttributable to procrastination or lack of 
experience with an activity of this nature. To my dismay, many 
portfolios still looked like notebooks - they contained nearly 
everything we had done rather than a collection of best work or items 
specifically related to students* subject area J. Of course this may 
be attributable to the scoring rubric which emphasized both quantity 
snd quality using language like "irrefutable" and "comprehensive." 

Despite these issues, we achieved much consensus on final grades 
#for the portfolios. For a first attempt with more specific purposss 
and scoring criteria, I was more aatiafied than the previous semester 
as indicated in my final journal entry. 
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I think the exit conferences and information on purposes and 
scoring rubric were helpful. A few students thought this would 
have been more helpful at midterm, but many agreed it was 
necessary at the end. I averaged about 80% agreement with 
students 9 self -assessment and feel that the rubric helped us all 
know what we were trying to accomplish. I do, however, plan to 
help students focus on including only those things that epitomize 
what they have learned about teaching and learning that impacts 
their respective subject areas. In addition, I msy want to 
consider identifying certain kinds of entries to include. All in 
all I wit infinitely more satisfied this semester than last, 
primarily because I did not specifically dictate entries via a 
checklist. The result were portfolios that belonged more to the 
students than me. 

Summer 1993 

Summer session courses have a two-hour, Monday-Friday, five-week 
structure, quite different from the regular sixteen-week semester. As 
a result, I had concerns about building a shared understanding in a 
compressed time frame. Daily meetings for a two-hour block proved 
beneficial, however. As students noted, "There isn't time to forget." 
Summer section students used the scoring rubric from Spring 1993 as a 
start, but opted to flesh out only the "A" category (See Appendix B) . 
Note that the emphasis is on QUALITY and BEST WORK. During 
discussions before midterm (Day 10) I emphasized that a portfolio is 
NOT a notebook which contains everything but rather a collection of 
carefully selected items, tagged with entry slips which evince what 
students have learned and expect to use in the future and WHY. An 
additional criteria would be an introduction to provide the reader 
with a "lens through which to view entries and provido s rationale for 
inclusions, organization , etc." * 

Sensing that clarification was still necessary, a few days after 
midterm (Day 14) I verbally explained "Portfolios as Process and 
Product: A Construction Metaphor." Appendix F is the written handout 
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that I created for use Fall 1993* Summer students had to endure an 
oral explanation and crudely drawn figure as I "talked them through" 
the idea, which resulted from late Spring/early Summer readings (Cole, 
1992; Belanoff & Dickson, 1991). Nonetheless, it was my perception 
that this activity did clarify both process and product issues for 
students • 

Once again we conducted portfolio exit conferences which probed 
three questions/issues, modified slightly from Spring 1993: 1) Think 
about where you were at beginning of the term in regard to your idear 
about teaching and learning and where you are now. What happened/Why? 
2) Think about your portfolio as both a process and a product. What 
process did you use to create the final product? 3) Using the scoring 
criteria we created, what grade do you deserve/Why? 

Analysis of exit conference notes revealed a shift away from some 
issues/concerns identified by Spring 1993 students and an increase in 
the range of perceived benefits/advantages. 

Issues/Concerns Benefits/Advantages 

-Logical organization -Quality/Best work 

-Time constraints -Pushed self to deserve grade 

-Inclusion decisions -Learned much 

-Personal use and applications 

-Future resource 

-Documents progress 

-Forced multiple interactions 

Apparently class discussions had more precisely conveyed the nature 

and intent of portfolios as process and product. Most were "smaller" 

and contained selections rather than the notebook approach of previous 

students. Once again we achieved 80% congruence on portfolio grades. 



ERIC 



10 



Nonetheless, in my final journal entry Summer 1993, I identified 
the following "persistent end troubling questions 19 : 

1) Some students are still concerned about H not knowing where we 
stand. 91 Does this mean according to a grade OR not knowing what 
they understand? 

2) How can I better describe/explain both the process and product 
aspects of portfolios in such a way to help students gain a 
better understanding of what it entails? 

3) How can I build in/help students acquire motivation and 
abilities necessary to think critically, s^lf -evaluate , reflect, 
analyse, etc.? 

A) How can I help students break through and emerge beyond the 
following mentalities? a) one-page (or less) reflective entries, 
b) doing superficial/ just enough work, c) unwillingness to take 
risks, d) one right answer, e) inability or unwillingness to make 
connections, f) grades more important that what is learned. 

My search for answers and alternatives yielded additional refinements 

for Pall 1993. 

Fall 1993 

As during previous semesters, portfolios were introduced early 
and students generated ideas about potential items to include prior to 
seeing my ideas. I devoted valuable class time to helping students 
understand both the nature and intent of portfolios. One new tool for 
Fall 1993, distributed during Week 2, was a three-page handout 
entitled "Portfolios as Process and Product: A Construction Metaphor 99 
(See Appendix F), which provided a detailed description about things 
to attend to throughout the semester in order to have an array of 
quality items to ensure a quality final product. Finally students 
would have a written reference about the portfolio as process and 
product • 
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Before midterm (Week 7), students received another handout, 
N Portf olios - The Process/Product Continues 11 (See Appendix G) 9 which 
further described a portfolio as H a collection of evidence with a 
purpose* M This handout, influenced by additional readings and 
dialogues with a new colleague who was also piloting portfolio 
assessment, identified several categories of evidence that items could 
document or demonstrate. The notion of categories of evidence, 
modified from Collins and Dana (1993), provided a focus or framework 
item selection* In addition, it articulated two questions that each 
entry slip accompanying a portfolio item should clarify. 

During our midterm "Portfolio Show and Tell" session (Week 9), 
students critiqued each other's entry slips and also received feedback 
from the instructor. Besides seeing various organizational 
structures, students also witnessed a range of potential items to 
include and how their peers had written entry slips. Most students 
reflected in learning logs/ journals that this was a very valuable 
class session. 

After midterm (Week 9), we began constructing portfolio scoring 
criteria using both Spring 1993 and Summer 1993 criteria as a starting 
point. Fall 1993 students also chose to flesh out only the "A" 
category (See Appendix H) . Note that information is also included 
about issues of quantity. Upon my colleague's recommendation, I had 
recently read an article that modified Haertel's (1990) notion of the 
"value-added principle" (Collins and Dana, 1993) and included it to 
assist students in the selection process and to help them know "when 
enough is enough." Judging from final Fall 1993 portfolios these 
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modifications and combination of activities provided an appropriate 
amount of flexibility and structure for the portfolio process/product. 

Portfolio exit conferences (Week 16) focused on the same three 
questions used during Summer 1993. Although some of the same 
issues/concerns emerged, students were more precise in articulating 
the nature of their concerns. Many more also lauded the portfolio 
process/product despite concerns* primarily because it afforded them 
the opportunity to guide their own learning and organize a document 
that truly reflected and charted their unique progress. This was 
particularly true for the few students who were also experiencing 
portfolios in my colleague's class. 

Issues/Concerns Benefits/Advantages 

-Tine constraints (Process and "Tells story of learning (Growth 

product time consuming) and development) 

-Importance of orgsnizat ion/ -Proud of/Pleased with product 

time management (Constant -Contains items for future use 

pressure) (Student teaching, employment, 

-Need to see examples (Entry future additions) 

slips & final portfolios) -Learning continuous (Multiple 

interactions/reflect! ops) 
-Individual i zed/Persona 1 i zed 
learning (All different) 

This time there was BIS agreement between student self -evaluation 
and my assessment of their portfolios. Por the first time we also had 
specific categories of evidence which allowed me to quantify 
selections made* Appendix I contains more detailed information 
identifying individual and subject ares entries in each category • 
What follows is a summary highlighting my observations about 
particular trends . 

tfe used six different categories of evidence for portfolio 
inclusions. 1) Growth and development. 2) Change in perspective or 
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belief (accosaodation), 3) Application/Modification of CAL/LTS, 

4) Connections between 368 end other classes/experiences . 

5) Confirmation or reinforcement of existing belief or perspective 
(assimilation), and 6) School of Education Knowledge Base. Although 
students were equipped with the "value-added principle" (See Appendix 
H). I did not suggest or require particular numbers of entries for the 
portfolio* Therefore I was interested to see how students would 
msnsge this component. There wss amazing consistency - totsl number 
of entries rsnged from 9-26, with an sversge of 15* 

Inclusions within categories rsnged from 0-9, indicsting much 
individusl selection. By thst I mesn the existence of s cstegory did 
not compell students to create items if it wss not deemed appropriate. 
(See Appendix I for a quantitative summsry of inclusions by subject 
sres major.) This wss particularly true for category aix, School of 
Education Knowledge Base which was sdded ss s possibility lste in the 
semester* I am currently re-evaluating its viability as s separate 
category and am considering at least two possibilities: 1) its merger 
with the portfolio's introduction or 2) having it serve as a 
foundation for a conclusion to the portfolio* As we move towsrd more 
progrsm congruence, it is vital to provide our students with 
opportunities to connect their lesrning in individual courses to our 
knowledge bsse* The portfolio is a most likely and viable tool to 
help us schieve better progrsm srticulstion . 

As previously noted, there was s wide range of items included in 
various categories* In descending order, cstegories used most 
frequently were: 1) Growth and development (average 4*6 entries). 
2) Application of CAL/LTS (average 3*2 entriea). 3) Confirmation of 
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belief or perspective (average 2.6 entries), 4) Change in belief or 
perspective (average 2.1 entries), 5) Connections between 368 and 
other classes/experiences (average 1.8 entries), and 6) SOE Knowledge 
Base (average .81 entry). A perusal of Appendix I will reveal no 
disceruable evidence that subject area impacted number of entries or 
types of categories used. 
Summary ant Discussion 

Lessons were learned and refinements made each semester of the 
portfolio journey. To summarize, 
Fall 1992 suggested that! 

1) teacher-directed portfolios can result in notebooks and lack of 
student ownership, and 

2) specific purposes and scoring criteria are critical. 
Spring 1993 indicated that! 

1) clear and precise focus on quality vs. quantity is essential, and 

2) creating assessment criteria or rubrics is a complex but meaningful 

activity . 

Summer 1993 revealed that : 

1) consistent and frequent emphasis on quality vs. quantity can yield 
more careful selection of entries, 

2) multiple messages to include only items related to or applicable in 
student's major/minor impacts selection decisions, and 

3) introduction of "Portfolio as Process and Product: A Construction 
Metaphor" helps students better understand a complex process which 
resulted in better final products. 

Pall 1993 reinforced that! 

1) a copy of the "construction metaphor" is a valuable reference to 
guide the process, 

2) identifying categories of evidence provides a focus and framework 
for careful selection of items, 
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3) clarifying the role of entry slips helps students sake and defend 
their selections, 

4) introduction of the "value-added principle" yields true portfolios 
with fewer but higher quality inclusions , 

5) portfolios have such potential to generate excitement abo^t 
learning and pride in accomplishments , and 

6) working through portfolio issues with a colleague provides 
necessary support and helps identify additional resources • 

Others involved in portfolio assessment have recently profferred 

similar insights. Bird (1990) notes that without a specific purpose a 

portfolio becomes a hodgepodge of documents. Herman, et al., (1992) 

reiterate the role of purpose and identify additional elements. 

The "assessment" in portfolio exists only when 1) an assessment 
purpose is defined; 2) criteria or methods for determining what 
is put into the portfolios, by whom, and when , are explicated J 
and 3) criteria for assessing either the collection or individual 
pieces of work are identified (p. 72). 

Furthermore, Barton and Collins (1993) provide this cogent 

description: "To qualify as a portfolio, each piece of evidence must 

be collected or crested and organized in a compelling manner to 

demonstrste proficiency in or progress toward a purpose" (p. 203). 

Although portfolios can be used for many purposes, it is vital that 

those purposes ba made explicit for those engaged in the process. 

Still others highlight the impact of portfolios on student 

learning. Mathiaa and Uphoff (1992) assert that the process is as 

important ss the product in promoting reflection about the program and 

professional development. Portfolio assessment also documents growth 

snd development, allows personslized assessment via choice and 

ownerahip, requires reflection and encourages self -evaluation , and 

assists in focused, orgsnized learning (Ohlhausen and Ford, 1990). 
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As * result of the Fall 1992 - Fall 1993 experience and related 
readings, I have found the following items to helpful regarding use 
of portfolios in teacher education: 

1) Clearly identify purpose(a), 

2) Involve students in the process (e.g. things to include, assessment 

criteria, self and peer critique, etc.), 

3) Schedule multiple work-in-progress and information sessions, 

4) Provide written descriptions, explanations, expectations, 

5) Display exemplar portfolios, 

6) Link process/product to overall program goals, 

7) Conduct exit conferences, 

8) Systematically study /monitor purposes and impact on student 

learning and modify accordingly, and 

9) Work with a colleague (if possible) to either initiate and/or 

refine use of portfolio assessment. 

Undoubtedly we have much to learn regarding use of portfolio 
assessment in teacher education. Aa noted by Hosenthal, et al., 
(1993), there is "inherent tension in constructing portfolios at the 
preservice, undergraduate level because students are at once learners 
and prospective teachers' 9 as well as "tension between documenting 
learning and showing expertise" (p. 3). An important role of teacher* 
educators is to mitigate the process/product tensions to help ensure 
assessment experiences that both inform and demonstrate student 
understanding . 

My most recent experience with portfolio assessment indicates 
that it is possible to esse these tensions which can result in student 
empowerment and ownership of the lesrning process. Hopefully, 
suggestions offered herein will provide others with either the spark 
to initiate portfolio assessment or additional considerations to 
enhance the process. Please share your results, Me must support each 
other to maximize the potential for our students. 
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APPENDIX A 



FORMATIVE ASSESSMENT - MIDTERM PORTFOLIO 

NUM 

Day/Use 

Please indicate itess you have included to DEMONSTRATE what you have 
learned in SDED 368 by checking the first coluan. I Mill use the second 
coluan for sy ispressions. The following rating scale night be useful: 

♦ (This belongs here - I understand why it's included.) 

? (I think it should be included but I need to do sore with it.) 

- (I did not include it because...) 

MINE RAFF 

1. SDED 368 Pretests with Reactions/Reflections 

2. Related Journal articles (Sunsaries/Reactions) 

3. Chapter Concept Maps 

4. Chapter Sussaries/Ref lective Entries 

5. Class Notes/Additional Reflections 

6. Feature Analysis arid (Chapter 4) 

7. Chapter 5 Reading/React ion/Noteta king Guide 

8. Additional Readability /Tex t checklist Activities 

9. Development of "pretest" of other initial assess- 

nent devices for EFE (CARI, student interviews, 
eubject-satter Motivation index, etc.) 

10. Potential Qs for Action Research/Inquiry 

11. Materials from other classes CLEARLY connected 

to SDED 368 concepts 

12. Personal reactions to Chapter 3 presentations 

and experience 

13. Self -Analysis/Reflection EFE Handbook pp. 35-37 

14. OTHERS (Please describe) 



9 

ERIC 



21 



Please assess your performance with a letter grade (A - F) on the 
following ORGANIZATION features: 

« ► 

"-NE RAFF 
1 . Neatly Packaged 

2. Evinces Tise/Energy/Ef fort (Both in packaging 

and HON it is arranged) 

3. Clear, Logical Organization and Sequence 

(Table of Contents* Labeled Sections* etc.) 

4. Planning for future inclusions (e.g. Daily 

Lesson Plans for EFE, Dally Reflective Log 
Entries, Materials crested to use with EFE student) 



•Attached to this assessment/analysis please include written responses 
to the following questions. Word processing will be greatly appreciated! 

1. Examine the above assessment. Based on the evidence provided, what 
GRADE (A - F) would you give yourself at midterm? WHY? 

2. How does this portfolio compare/contrast with the one we examined 
earlier in the semester? To increase your level of satisfaction with your 
work what else needs to be done? 

3. Which things from Chapters 1-5 do you understand most thoroughly? WHY? 
What suggestions do you have for future class activities that will help you 
learn more from this course? It is important that I find multiple ways to 
meet the needs of ALL SDED 368 students - I value your input I 
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APPENDIX B 



FINAL PORTFOLIO - SDED 368 

Please include only those items which clearly and precisely 
DEMONSTRATE YOUR INVOLVEMENT WITH AND UNDERSTANDING OF key 
ideas/concepts from SDED 368. This DEMONSTRATION may take a variety 
of forms but loit likely will involve reflection, analysis , and self- 
assessment. It is not expected that all items listed need to be 
included but point totals for each category should help you identify, 
prioritize, and allocate your time/resources . 

Please indicate items included by using the following analysis 
scale* The first coluin is for your assessment; the second is for 
Rafferty. Point totals in parentheses indicate total number possible 
for each category* 

♦ (This belongs here - I have shown why it is included.) 

? (I think this belongs but had some trouble relating it to major.) 

0 (This was not a helpful or relevant assignment for me as student 

or for my subject area. Therefore, it is not included.) 
- (I was absent and/or did not complete this task.) 
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SELF-ASSESSMENT (4) 

Pre/Post Knowledge Attitude Surveys 

Self~analysis/Ref lection EFE Handbook 

Portfolio Self-assessments (Sept, Midterm 
and Final ) 

CLASS NOTES , PRESENTATIONS , ASSIGNMENTS (18) 
Class Notes with Reactions/Reflections 
Readability/Text Evaluation/Reflections 
Chapter 5 Notetaking Guide/Notes 
Presentations (Plans, Materials, Reflections) 
Reading Process (Chpt. 3) 
Vocabulary (Chpt. 6) 

Comprehension Across Dimensions of Learning 
(Chpt. 7) 

Writing/Discussion Strategies - Written 
Explanations/Reactions (Chpts. 10 & 11) 

Unit Plan (CAL/LTS Before, Ouring, After) 
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3. SUHM AR Y/S YNTHES I S ACTIVITIES (12) 

Chapter Summaries/Deflective Entries 
Chapter Concept Maps 

Journal Articles from Subject Area/Reflection 
Literacy Defined in Subject Area 
Various Feature Analysis Grids 

4. EFE ACTIVITIES (9) 

Daily Lesson Plans and Materials 
Daily Reflective Journal Entries 
Data Gathered for Action Research 

5. MATERIALS FROM OTHER CLASSES (3) 

PROVIDE EXPLANATION OF HOW THESE INCLUSIONS 
ARE CONNECTED AND WHY THEY ARE INCLUDED HERE. 

6. ORGANIZATION/PRESENTATION (4) 

(Time/Energy/Effort; Packaging; Organization/ 
Arrangement ) 



ATTACHED TO THIS ASSESSMENT/ANALYSIS PLEASE INCLUDE THOUGHTFUL AND 
HONEST RESPONSES TO THE FOLLOWING QUESTIONS . I NEED YOUR INPUT TO 
CONTINUE TO IHPROVE THE COURSE FOR NEXT SEMESTER. WORD PROCESSING 
WILL BE GREATLY APPRECIATED! 

1. Examine your column of this assessment. Based on the evidence 
provided, what GRADE (A - F) would you give yourself on this portfolio 
which represents 50% of your total semester grade? WHY? 

2. For many, keeping a portfolio was a new experience. What did you 
learn about yourself as student and prospective teacher? How does 
this type of assessment compare/contrast with traditional formats? 
Which do you prefer and WHY? What suggestions do you have for 
improving use of portfolios as both "instructional and assessment* 
tools? From the array of activities included in this portfolio from 
which did you learn the most - WHY? 

THANK YOU FOR YOUR INPUT! AS YOU KNOW I AM CONSTANTLY SEEKING WAYS TO 
IMPROVE TEACHING AND LEARNING IN MY CLASSES. YOUR PARTICIPATION MAKES 
A VALUABLE CONTRIBUTION TO THOSE EFFORTS! 



24 



APPENDIX C 



ASSESSMENT CRITERIA - CINT 368 

("Not everything that counts can be counted and not everything that can be 
counted counts.* Sign posted on Albert Einstein's office wall.) 



ASSESSMENT 



PURPOSE 



CRITERIA 



Substantive and 
meaningful partici- 
pation (20%) 



•Promote critical literacy 
skills (Reading, Writing* 
Listening* Speaking, and 
Thinking) 

•Flesh out an array of 
ideas and perspectives 

•Continue to process concepts 

•Create a learning community 



-Attendance 

'Regular voluntary 
responses 

-Willingness to 
offer diverse/ 
divergent/unusual 
ideas 

-Connecting ideas 
to those of text, 
peers , i nstructor 



EFE LOG/ 

Inquiry Project (20%) 



-Promote observation and 
reflection 

-Build basic data collection 
and analysis skills as 
foundation for future 
action research activity 

-Reinforce importance of 
clear /precise communica- 
tion (oral/written) 

-Experience "kid-watching" 
and rapport-building in 
indiv/small group setting 

-Connect observations/findings 
to major learning theories 
(e.g. Piaget, Kohlberg, 
Erickson, etc.) to gain 
insights into teaching/ 
learning process 



•Follow written 

guidelines 
-Quality of data 

collection and 

analysis 

-Soundness of con- 
clusions/insights 

-Connections to 
existing research 
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ASSESSMENT 
Concept Map (30*) 



PURPOSE 

-Synthesize nmjor concepts 

-Connect Content Literacy 
to subject area 

-Organize, frame, and de- 
pict one's understanding 

-Construct/reconstruct one's 
understanding 

-Understand that learning is 
active/ongoing not passive/ 
static 



CRITERIA 

-Clarity of pr as- 
sentation 

-Precise "logical 
connectives" 

-Time, energy, 
effort 

-Comprehensible 
representation of 
Content Literacy 
in subject area 
(with necessary 
adaptations ) 



Portfolio (30*) 



-Hone organizational skills 
-Promote self-assessment 
-Promote reaction/reflection 

on various readings 
-Compile materials for 

future reference 
-Provide repository for EFE 

journal, lessons, materials 
-Promote summary/synthesis 

activities 
-Promote connections to major 

and other Ed. classes 
-Opportunities to visit and 

revisit materials read, 

discussed, created, etc. 

for meaningful , long-term 

understanding 



-Organization and 
packaging (Time, 
energy, effort, 
ease of location) 

-Depth/Breadth of 
items reflecting 
potential CAL/LTS 
use in major 

•Rationale/ Justifi- 
cation for each 
item included 
(e.g. entry slip) 

"Evidence of neces- 
sary /appr opr i ate 
adaptations of 
CAL/LTS to 
subject area 
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APPENDIX D 



PORTFOLIO SCORING RURRIO 



To aesifct you in sal f -assessing your portfolio for OIMT 3*8, 
please refar to the following deeoript ions /categories . Pleaae talk to 
me if you UQ*<i additional information or olarif ioat ion • 

(A) Vftry comprehensive both in ranga (quantity) and quality of 
itaaia included; Thoughtful, well~concei vad , orgeniied, and uitr- 
friandly format; Daacriptiva and datailad tabla of contents! 
Subetantial and conaiatant avidanca of intaraotion ici th/undaratanding 
of raadinga (taxt and handouts); Irrafutabla avidanoa of 
reaction/reflection to diacuaaiona and othar alaaa aotivitiaa; 
Evidence of aubjact araa journal raadinga and othar attempts to link 
CIMT 368 to major/minor, ate. 

(B*) Comprehensive in either ranga (quantity) or quality of items 

included; (fall-organized, user-f riendly format; Helpful tabla of 
contanta; Much evidence of interaction * ith/underatanding of raadinga 
(text and handouts); Considerable evidence of reaction/reflection to 
discussions or other cleat activities; Evidence of aubjact area 
journal readings or other attempts to link CIMT 368 to ma jor/minor , 
etc • 

(B) Comprehensive; Organized format; Helpful table of contanta; 
Evidence of interaction with/understanding of text readings; Some 
reaction to or reflection on class activities; Some linkagea between 
CIMT and major and/or minor » etc* 

(C/C+) Fairly comprehensive; Minimal organization/structure; Baaic 
table of contents; Some reaet ion/reflect ion to readings, etc 



(D/D+) Minimal inclusions; Lack of organization; Lack of evidence 
of time, energy, effort, to produoe an acceptable portfolio, etc* 



APPENDIX E 



GIMT 366 - PORTFOLIO SCORING CRITERIA - SUMMER 1993 

The following description ii intended to assist you in self- 
assessing your portfolio for GIMT 361. If you need edditionsl 
information or elcrif icstion, please tslk to as as soon as possible. 

(A) To earn an "A" the portfolio mist provide IRREFUTABLE EVIDENCE OF 
QUALITY IN ALL RESPECTS . In other words, it should be your BEST WORK. 
Please refer to lists we genersted in cless end the handout you 
received about types of things that could be included in your 
portfolio for this class. Also refer to sssessaent criterie sheet 
that explains PURPOSES and general categories of CRITERIA. 

The following iteas provide ■ore detail about structural or 
organizational features that should help ensure a quality product. 

-Introduction end Teble of Contents 
-Well-conceived foraat with logical organisation 
-Justification for iteas included 

-Demonstration of interaction with/understanding of text readings 
-Deaonstretion of interaction with/understending of handouts/articles 
-Reaction/reflection on class discussions/activities (This could be 

part of learning log/journal with entry dates end titles, etc.) 
-Various connections between CIMT 368 and aajor/ainor (e.g. Rating 
scale for usefulness/potential applicability; saaple lesson plans 
using 368 concepts/strategies; adaptat ions/aodif icatons of certain 
strategies to fit aajor/ainor; related readings froa professional 
journals or conferences, etc.) 



Please note thet you will be asked to essess your portfolio using 
these criteria. It will be your responsibility to convince ae why you 
deserve an "A, B+, B, C+" etc. 
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APPENDIX F 



PORTFOLIOS AS PROCESS AND PRODUCT : A CONSTRUCTION METAPHOR 

For «any CINT 368 students , the types of assessment used will be 
new. While this can be disconcerting/uncomfortable, it also provides 
an opportunity for new experiences - experiences that have the 
potential to help you learn new ways to think about teaching and 
learning in your future classroom. 

Portfolios can be described as both process and product. By that 
I aean that through the process of learning through a variety of 
experiences in CIMT 368 you will have the "raw materials'* to construct 
a final product callad a portfolio. The major purpose of your final 
portfolio is to meaningfully display WHAT was learned, HOW it was 
learnod, and current (EFE) and future uses/applications. Via your 
portfolio you are to demonstrate your "interaction with and 
understanding of" CIMT 368. Another way to think about your portfolio 
is that it will document , chronicle , or provide evidence of your level 
of understanding - it will be a HISTORY of your learning this 
semester • 

It might be helpful to think of constructing a portfolio by 
comparing it to the building process. Construction usually begins 
from the ground up and proceeds with various levels or stages. 
Portfolios are similar. Refer to the attached diagram and follow the 
number sequence through this explanation. 

Portfolio Construction Process/Product 

1) FOUNDATION - Just as laying concrete or building blocks will 
provide a base and strong foundation for future work, so will the 
fundamentals or foundation-building for CIMT 368. It is essential 
that you read and mentally digest assigned information. This basic 
level is also know as "What does it say?" What ideas/concepts are the 
authors trying to convey? 

2) FRAMING/STRUCTURE - After the foundation is in place, a building 
begine to take shape during framing. The shape and size of a building 
is determined by its purpose. This level can be referred to as "What 
does it mean? 1 * because there is room for individual interpretation at 
this level. Authors use words to convey ideas, but the words actually 
take shape/have meaning when interpreted by the reader/learner. By 
reacting to/reflecting upon the readings and discussions, your own 
Ideas will take shape during this stage. Activities to help you 
achieve this level or stage could be written journal entries, creation 
of analogies or metaphors, visual representations of what the ideas 
mean to you, etc. 

3) ROOF - The final stage of external preparation usu lly includes the 
roof which provides closure and integrity for the structure. A 
parallel for the portfolio would be "How can I use it?" or what 
applications can be made to my own teaching? Activities could include 
planning for EFE (field experience) lessons, items created or modified 
from other methods classes that include CIMT 368 concepts, etc. 



Building Codes/Quality Issues 

With buildings and portfolios there are construction codes and 
quality issues. For portfolios* students are usually concerned with 
what constitutes an "A," "B+," etc. There is a difference between 
going through the motions or getting it done vs. using your portfolio 
as a genuine learning opportunity. 

The quality of your foundation/structure depends on the quality 
of reading, reacting, reflecting, listening, discussing, and adapting 
or modifying techniques for your subject area. Will you use 2 x 4s or 
2 x 6s? Will you place studs every 8. 12. or 16 Inches? Will you 
frame the building on concrete slab or cement blocks? In other words, 
what you put into constructing your understanding will determine the 
quality of your knowledge structure! 

Using the Process to Complete the Final Product 

If you have systematically moved from Foundation to Framing to 
Roof (What does it say? What does it mean? How can I use it?) you 
should have raw materials for final portfolio construction. As 
mentioned in the previous section, the quality of your raw materials 
and ultimately the final product will be determined by what you have 
done throughout the semester. I will NOT tell you what to include and 
how to arrange it - it is YOUR portfolio. I do, however, have two 
structural components that need to be included: 

a) Introduction - This section will serve as an overview of the 
process and product, provide reasons for your selections, their 
arrangement, and how this activity impacted your learning and 
understanding. The introduction should provide the reader with a lens 
through which to view your work. 

b) Table of Contents - This feature will lay out the structure and 
organization to help the reader conceptualize your organization and 
locate specific sections/items. 
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APPENDIX G 

PORTFOLIOS • THE WMCESS/PROOUCT CONTINUES 

(MAKING DECISIONS: WHAT TO INCLUDE, WHY TO INCLUDE IT, 
AND HOW TO JUSTIFY ITS INCLUSION - CIHT 368) 

Earlier this semeeter you read pages from the Conley text 
(pp. 369-373) and received handouts (Assessment Criteria - CIHT 368 
and Portfolios as Process and Product: A Construction Hetaphor). I 
encourage you to revisit these readings in conjunction with taking 
decisions regarding your portfolio. The ideas contained in the rest 
of this handout are drawn from: Conley, my colleague Or. Tom 
Dickinson, various readings and conversations with others who are 
experimenting with portfolio assessment, and my own metacognitive 
analyses based on use of portfolios in CIHT 368 beginning Fall 1992. 

A portfolio is a collection of evidence with a purpose. Specific 
purposes were outlined in earlier handouts cited above, but generally 
portfolios illustrate what a student knows and is able to do. At the 
same time, however, portfolios are NOT a repository of every paper, 
handout, test, homework assignment, Journal entry, metacognitive 
reflection, bulletin board item, etc. that you have done during the 
semester. In fact, a critical feature of a quality portfolio is that 
students assume the responsibility to include only certain items that 
beet illustrate their "learning journey.* 

Portfolioe should stimulate reflective dialogue between students 
and teacher to enable both to reflect upon what skills have been 
gained, what go§le have been reached, and what needs to occur to 
ensure continued learning. Given the nature of CIHT 368, it seems 
that you can use portfolios to demonstrate things like the following: 

1) <iiu s»v«4.«nNi«^t (of what) 

2) e JUm> ^M4it*ttJttv«. mm* Stiu< (Accommodation) 

(Contmnt Area Literacy/Learning Teaching Strategies) 

um- i»M,«»«.e-4>Lv«. (Assimilation) 

For aach item/category of items included, there should be an "entry 
slip" or "caption- attached that explains what it is, what it is 
evidence of, and why it is evidence. In other words, you will 
Justify its inclusion in the portfolio. Rather than a notebook full 
of everything you have done for CIMT 368, your portfolio is a 
carefully designed collection of specific items that are included for 
particular purposes or reaaona. To assist you in making crucial 
selection decisions, I recommend that you ask yourself questions such 
as the following and then write up an entry slip containing your 
responses i 

-What is this evidence of? (e.g. growth/development; change in belief I 

application of a particular strategy! etc.) 
-How/why/in what ways does this item demonetrats this particular 

thing? 
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CIMT 368 - PORTFOLIO SCORING CRITERIA/DESCRIPTION - PALL 1993 

The following description is intended to assist you in self- 
assessing your portfolio for CIMT 368. If you need additional 
information or clarification* please talk to mm aa aoon ao possible* 

(A) To earn an M A" the portfolio mist provide IRREFUTABLE EVIDENCE OF 
QUALITY IN ALL RESPECTS . In other words, it should be your BEST WORK* 
Please refer to lists we generated in claas end the handout you 
received about types of things that could be included in your 
portfolio for this class. Also refer to assessment criteria aheet 
that explains PURPOSES and general categoriea of CRITERIA. In 
addition» reread handouts entitled* "Portfolio as Process and Product: 
A Conatruction Metaphor" and "Portfolios - The Process/Product 
Continues" for further clarifying information. Recent diacuaaions in 
claas revealed a conaenaua that the primary purpose for the portfolio 
is for you to demonstrate what you have learned and how thia learning 
will enable you to be a better teacher. 

The following items provide more detail about atructural or 
organizational featurea that should help ensure a quality product. 

-Introduction and Table of Contents ( Typed/Word-Processed ) 
-Well-conceived format organized for personal use 
-Professionally packaged and presented 

-Justification for items included (Typed entry slips that thoroughly 
answer two important questions and identify items according to 
following six categories of evidence: 

1) Growth and Development (of what), 2) Change in Perspective 
or Belief (Accommodation), 3) Application/Modification of 
CAL/LTS, 4) Connections Between 368 and Other Classes or 
Experiences, 6) Confirmation/Reinforcement of Existing Belief 
or Perspective (Assimilation), 6) Becoming a Complete Pro- 
fessional (School of Education Knowledge Base). 

When we addressed issues of quantity, there was overwhelming 
consensus that specific numbers, minimums or maximums NOT be suggested 
or imposed. It seems that items selected will depend on the 
individual, the individual's subject area, and emerging teaching 
philosophy or style. Likewise, the number of items necessary to 
provide evidence of what was learned and how is also an individual 
matter. To paraphrase one written comment, 'Quantity will be 
determined individually based on what one decides is important and 
supports his/her subject area. The portfolio should include what each 
person determines will enhance his/her future teaching. 1 

Nonetheless, an article in the November 1993 issue of Middle 
School Journal contains a potentially helpful idea regarding how much 
evidence to include. It is called the "value-added principle** and 
works as follows. 

From all the accumulated documents that might be evidence, the 
student selects the one document that provides the most 
compelling evidence of having met the purpose of the portfolio. 
This piece of evidence is set aside. Then a second piece of 
evidence is chosen and the student asks himself or peers, "What 
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value will be added to the portfolio if this piece of evidence is 
included?" The process of adding pieces of evidence is repeated 
until the answer is "nothing" and the limit of pieces of evidence 
has been reached. 

From experience we have learned a twist to the value-addod 
principle. The first document that is rejected as adding nothing 
to the portfolio is not the last piece of evidence that should be 
examined. Students should review (other) documents that are 
potential evidence to be sure they have not overlooked something 
compelling. When students make the nothing-new-is-added decision 
about several pieces of evidence, they feel more confident about 
the quality of their portfolios <pp. 16-17). 



Please note that you will be asked to assess your portfolio using 
these criteria. During our exit conference the week before final 
exams it will be your responsibility to explain the type of grade you 
deserve and why. 
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PALL 1993 - PORTFOLIO SUMMARY DATA 



SHaiftEiH of Evidence! 

1) Growth and Development 

2) Change in Perapective or Belief 

3) Application/Modification of CAL/LTS 

4) Connection! between 368 end other Classes/Experience* 

5) Conf irmation/Reinf orcement of Existing Belief or Perspective 

6) School of Education Knowledge Base 

ttiifli Cittiorr total entries 
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Buaineaa 



ER?C 





6 


1 


2 


2 


2 


0 


13 




0 


4 


1 


5 


3 


2 


15 


Bled* Rug* 


3 


2 


2 


3 


4 


0 


14 


Engl ten 


0 


«i 
J 


A 
«♦ 




1 


0 


10 


Indue. Tech. 


4 


3 


3 


2 


2 


0 


14 




5 


1 


3 


0 


1 


3 


15 




3 


3 


6 


2 


2 


0 


16 




4 


I 


t, 
5 


ft. 


2 


0 


16 


Matn 


0 


1 


2 


2 


• 
1 


2 


15 




1 i 
1 1 


2 


1 


0 




0 


16 




4 


4 


3 


3 


i 


0 


15 




1 


4 


3 


1 


0 


0 


9 




j 




d 


A 

u 


2 


A 
U 


12 




5 


i 


2 


0 


l 


3 


12 




4 


4 


8 


2 


4 


2 


24 




4 


0 


6 


0 


1 


1 


12 




4 


2 


i 


0 


6 


0 


18 


Muaic 


2 


S 


0 


1 


1 


0 


9 




4 


4 


2 


2 


3 


0 


15 


Phys. Bd. 


3 


1 


0 


1 


3 


0 


10 




6 


0 


0 


1 


2 


1 


10 




2 


2 


4 


2 


2 


0 


12 




6 


1 


2 


2 


3 


8 


24 




* 


3 


4 


3 


1 


0 


15 


Science 


13 


1 


2 


2 


a 


0 


26 


loo. Btudiee 


3 


0 


2 


3 


l 


1 


12 




3 


3 


5 


3 


2 


0 


18 




9 


2 


0 


3 


S 


0 


18 




3 


3 


3 


1 


1 


0 


11 




a 


S 


3 


3 


3 


3 


22 


Bpanlah 


2 


0 


3 


1 


3 


0 


11 



(Average 14) 



(Average 15.2) 



(Average 14.7) 



(Average 12) 



(Average 14.2) 



(Average 16.2) 



